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1.  Status  of  Effort 

The  three- year  effort  led  to  a  number  of  important  research  milestones  in  the 
topic  of  information  theory  and  its  application  to  image  formation,  detection, 
and  processing.  Essentially  all  of  the  objectives  of  the  original  proposal  were 
accomplished,  and  additionally  some  new  directions  of  information-theoretic 
imaging  research  were  explored. 


2.  Accomplishments  and  New  Findings 

Described  below  are  highlights  of  research  and  their  significance/relevance 
to  the  field  of  imaging  and  the  scientific,  industrial,  and  military  community. 

a.  Noise  reduction  and  information  gain  from  prior  knowledge 
of  object  support 

Most  image  processing  algorithms  implement  prior  knowledge  about  the 
object  in  one  form  or  another.  Thus,  for  example,  the  two  workhorses  of  as¬ 
tronomical  image  processing,  namely  the  maximum-entropy  method  (MEM) 
and  CLEAN  algorithms,  each  assume  a  certain  object  structure,  a  diffuse 
object  and  an  object  consisting  of  point  sources,  respectively.  A  very  useful 
piece  of  prior  knowledge  that  can  lead  to  improved  processing  is  the  sup¬ 
port  of  the  object  intensity  distribution,  sometimes  available  from  either 
low-resolution  images  or  other  kinds  of  reconnaisance. 

A  precise  knowledge  of  object  support  can  reduce  noise  in  two  ways: 
First,  because  the  object  is  known  not  to  extend  beyond  the  support  bound¬ 
ary,  any  observed  image  data  with  intensity  well  outside  the  support  bound- 
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ary  must  be  pure  noise,  which  can  then  be  trivially  eliminated.  Second,  the 
imposition  of  support  in  the  image  domain  via  a  multiplication  of  the  obe- 
served  image  data  by  a  support  function  that  is  1  within  the  support  and 
0  outside  means  that  the  spectrum  of  the  support-constrained  image  is  a 
convolution  of  the  unconstrained  image  spectrum  and  the  support-function 
spectrum.  Such  a  convolution  will  lead  to  a  transport  of  noise  across  spa¬ 
tial  frequencies,  which  can  be  used  to  reduce  the  noise  within  the  support 
boundary  as  well  via  a  noise-reduction  algorithm  first  proposed  by  Matson 
and  Tyler. 

Under  the  present  AFOSR  grant,  the  present  PI  (Prasad)  greatly  clari¬ 
fied  the  detailed  nature  of  this  noise  transport.  The  transport  of  noise  occurs 
in  this  model  by  a  combination  of  ballistic  motion,  or  drift,  and  diffusive 
spreading  described  an  infinite  hierarchy  of  generalized  diffusion  constants. 
For  an  inversion-symmetric  support,  it  was  shown  that  the  drift  is  absent 
and  noise  transport  is  exclusively  diffusive.  For  this  case,  an  analytical  ex¬ 
pression  was  derived  for  the  reduction  of  noise  such  diffusive  spreading  in  the 
spatial-frequency  plane  can  facilitate,  when  a  circular  support  of  arbitrary 
size  is  employed.  Details  may  be  found  in  Ref.  [3]  which  was  supported  by 
a  precursor  AFOSR  grant. 

An  alternative  but  presumably  entirely  equivalent  viewpoint  is  to  con¬ 
sider  how  the  information  content  of  an  image  improves  with  the  application 
of  a  priori  constraints  like  the  finiteness  of  support.  This  picture  can  be  ac¬ 
corded  quantitative  meaning  via  the  concept  of  Shannon’s  statistical  entropy 
[1,  2]  whereby  a  statistical  set  of  representative  objects,  rather  than  a  single 
object,  is  processed  by  a  finite-bandwidth  imaging  system  in  the  presence 
of  noise.  Image  reconstruction  under  noisy  conditions  reduces  the  amount 
of  object  information  that  can  be  passed  by  the  imaging  system,  but  that 
reduction  is  expected  to  be  smaller  when  some  a  priori  information  about 
the  objects  like  finite  support  can  be  implemented  in  the  reconstruction  al¬ 
gorithm.  The  influence  of  an  a  priori  constraint  on  the  degree  of  reduction 
of  information  can  thus  be  assessed  for  the  object  set  chosen.  Obviously 
it  would  also  be  possible  to  estimate  how  meaningful  different  constraints 
would  be  for  different  object  sets  and  under  different  operating  conditions. 
A  preliminary  analysis  of  this  information-theoretic  viewpoint  for  the  sup¬ 
port  constraint  was  given  in  two  earlier  papers  by  the  author  [4]  and  David 
Tyler  [5]  under  support  from  a  previous  AFOSR  grant. 


b.  Statistical  information  as  a  performance  metric  for  itera¬ 
tive  image  processing 

The  value  of  iterative  image  processing  has  been  well  established  in  gener¬ 
ating  images  that  display  a  delicate  balance  between  resolution,  noise,  and 
dynamic  range.  The  most  serious  problem  facing  image  processing,  whether 
iterative  or  not,  however,  is  the  matter  of  choosing  one  or  more  regulariza¬ 
tion  parameters  that  determine  this  delicate  balance  in  the  restored  image. 
A  number  of  approaches  have  been  adopted  to  regularize  the  problem.  These 
approaches  range  from  added  damping  to  prevent  excessive  noise  amplifi¬ 
cation  to  restoring  images  on  a  reduced-resolution  template  (the  method  of 
sieves)  to  the  method  of  cross-validation  to  penalized  restoration. 

An  approach  that  the  PI  has  suggested  in  work  supported  by  the  AFOSR 
grant  is  to  use  statistical  information  as  a  regularizer  and  restoration  met¬ 
ric.  We  have  carried  out  a  statistical-information  based  analysis  [6]  of  the 
popular  Richardson-Lucy  iterative  deblurring  algorithm  after  clarifying  the 
detailed  nature  of  noise  amplification  and  resolution  recovery  as  the  algo¬ 
rithm  iterates.  Monitoring  the  information  content  of  the  reconstructed 
image  furnishes  an  alternative  criterion  for  assessing  and  stopping  such  an 
iterative  algorithm.  It  is  straightforward  to  implement  prior  knowledge  and 
other  conditioning  tools  in  this  statistical  approach.  Both  Gaussian  detec¬ 
tor  noise  and  Poisson  shot  noise  were  considered  in  this  work,  and  similar 
information  peaks  were  seen  as  functions  of  iteration  number  in  all  spatial- 
spectral  bands  over  which  information  was  monitored.  It  is  conjectured  that 
information  is  maxmimized  when  the  above-mentioned  delicate  balance  be¬ 
tween  the  various  indicators  of  good  image  quality  has  been  reached.  This 
approach  also  allows  for  a  comparison  of  various  iterative  methods  on  the 
same  object  classes  and  given  system  operating  conditions,  as  we  demon¬ 
strated  in  concurrent  work  [7]. 

This  work  has  been  greatly  generalized  and  expanded  by  the  Ph.D.  dis¬ 
sertation  work  of  Dr.  Douglas  Hope  [8]  under  the  Pi’s  supervision.  He  has 
applied  the  information  theoretic  characterization  to  both  filled-aperture 
and  sparse-array  interferometric  imaging  as  well  as  speckle  interferome¬ 
try,  and  has  studied  the  detailed  relation  between  the  traditional  noise- 
based  analysis  and  our  new  information-based  analysis  of  these  imaging 
approaches.  Thanks  to  these  advances,  principally  enabled  by  the  AFOSR 
grant  support,  information  based  assessments  of  imaging  systems  seem  to 
be  gaining  popularity,  at  least  in  the  DoD  community.  An  emerging  project 
called  Enhancement  via  Information  Theoretic  Analysis  (EVITA),  an  AFRL- 
Boeing  LTS  joint  activity  under  which  the  University  of  New  Mexico  is  also 
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supported  by  a  subcontract,  is  a  direct  result  of  our  successful  information- 
theoretic  imaging  researches. 

c.  Fisher  information  with  respect  to  cumulants 

In  our  AFOSR-grant  funded  researches,  we  have  considered  both  statistical 
information,  as  introduced  by  Shannon,  and  Fisher  information,  a  statistical- 
estimation-theoretic  information  measure.  The  inverse  of  Fisher  information 
(FI)  provides  the  lowest  possible  theoretical  bound  on  the  error  of  estimation 
of  a  parameter  from  statistical  data.  Specifically,  the  FI  is  a  direct  measure 
of  the  sensitivity  of  statistical  data,  via  their  probability  distribution  (PD), 
on  the  parameter  to  be  estimated  from  those  data. 

The  nature  of  FI,  introduced  nearly  eighty  years  ago  [9]  and  applied 
to  a  large  variety  of  problems  in  all  domains  of  statistical  analysis  during 
this  time,  is  well  understood.  Yet,  in  a  rather  seminal  work  [11],  the  PI  in 
collaboration  with  a  very  bright  undergraduate,  Nicolas  Menicucci,  showed 
that  the  concept  of  FI,  which  is  a  functional  of  the  PD  of  the  data,  can  be 
utilized  in  estimating  the  PD  itself.  Any  PD  is  characterized  by  one  or  more 
parameters  (such  as  the  mean  and  variance)  as  well  as  a  functional  form 
(e.g.,  Gaussian,  Poisson,  binomial,  etc),  and  estimating  these  parameters 
and  the  functional  form  is  then  equivalent  to  estimating  the  PD  itself.  The 
authors  showed  that  by  parameterizing  the  PD  in  terms  of  all  its  cumulants, 
one  has  a  direct  handle  on  the  explicit  parameters  as  well  as  the  functional 
form  of  the  PD.  The  estimation  of  the  PD  then  reduces  to  estimating  the 
cumulants  of  the  distribution,  relative  to  which  the  FI  can  be  written  down. 
The  FI  with  respect  to  cumulants  is  an  infinite-dimensional  matrix,  but  the 
authors  showed  that  the  form  of  all  the  matrix  elements  is  rather  simple  and 
analytically  expressible  in  closed  form.  The  simple  analytical  form  can  be 
used  to  motivate  a  number  of  generating  functions  for  the  FI  and  its  inverse 
matrix,  the  diagonal  elements  of  the  latter  providing  the  bounds,  the  so- 
called  Cramer-Rao  lower  bounds,  on  the  variance  of  the  estimators  for  the 
cumulants.  These  bounds,  taken  together,  may  be  regarded  as  determining 
the  best  possible  accuracy  with  which  the  PD  itself  can  be  estimated,  since 
the  PD  is  a  unique  function  of  its  cumulants. 

There  is  an  important  possible  application  of  this  work  to  imaging  that 
we  are  currently  exploring.  Note  that  the  spatial  distribution  of  intensity 
in  any  image  may  be  regarded  as  a  PD,  for  image  intensities  are  always 
nonnegative  and  the  total  image  flux  is  always  finite  and  thus  one  can  always 
normalize  an  image  distribution  so  that  all  its  pixel  intensities  add  to  1  just 
as  the  probabilities  in  a  PD.  Image  restoration  is  then  equivalent  formally  to 
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estimating  a  PD,  which  can  be  done  iteratively,  starting  from  the  observed 
(but  normalized)  image  data  that  can  hopefully  be  refined  iteratively  with 
improving  knowledge  of  the  equivalent  PD  and  thus,  via  our  work,  of  the 
accuracy  with  which  the  PD  can  be  estimated  at  a  specific  iteration  number. 
Just  how  the  iterations  refine  the  estimation  process  is  currently  under  study. 

d.  Fisher-information  based  optimization  of  phase  diversity- 
blind  deconvolution 

FI  can  be  used  in  much  the  same  way  as  Shannon  information  to  characterize 
the  quality  of  image  restoration.  There  is,  however,  a  qualitative  difference 
of  interpretation:  An  FI  based  metric  yields  the  goodness  of  estimation  of 
object  parameters,  while  any  Shannon  information  based  metric  is  a  mea¬ 
sure  of  the  goodness  of  discrimination  between  object  scenes  belonging  to 
a  statistical  ensemble  of  object  scenes.  Regardless  of  this  qualitative  dif¬ 
ference,  both  kinds  of  metrics  can  serve  as  excellent  objective  measures  of 
image  quality. 

Phase  diversity  speckle  (PDS)  imaging  is  a  type  of  blind  deconvolution 
algorithm  for  image  restoration  from  data  that  consist  of  multiple  images 
collected  by  a  ground-based  telescope  under  the  same  but  unknown  atmo¬ 
spheric  (or  speckle)  conditions.  The  success  of  PDS  image  restoration  has 
to  do  with  the  fact  that  the  object  being  reconstructed  as  well  as  the  atmo¬ 
spheric  turbulence  parameters,  although  not  known  a  priori ,  are  nevertheless 
the  same  across  the  multiple  image  channels.  Coupled  with  the  positivity 
of  the  image  and  a  statistical  knowledge  of  turbulence,  the  determination 
of  the  object  becomes  a  reliably  unique  process,  provided  enough  diversity 
("differentness”)  exists  across  the  multiple  channels.  In  conventional  PDS 
system,  there  are  two  image  channels,  one  corresponding  to  an  in-focus  im¬ 
age  and  another  corresponding  to  a  defocused  image.  Basically,  light  from 
the  source  is  split  in  two  equal  sub-beams  which  are  then  imaged  on  to  two 
cameras,  one  of  which  is  in  perfect  focus  and  the  other  slightly  out  of  fo¬ 
cus.  The  diversity  phase  in  this  case  is  the  defocus  induced  quadratic  phase 
profile  across  the  pupil  in  the  second  imaging  channel. 

That  the  defocus  cannot  be  too  small  or  too  large  for  optimum  perfor¬ 
mance  of  the  PDS  system  can  be  argued  as  follows.  If  the  defocus  were  too 
small,  the  defocused  image  would  be  essentially  indistinguishable  from  the 
in-focus  image,  adding  little  information  to  the  latter,  while  for  too  large 
a  defocus,  the  defocused  image  would  be  too  fuzzy  and  faint,  and  thus  too 
noisy  to  carry  much  useful  additional  information  about  the  object.  It  is 
clear  that  optimum  performance  is  obtained  when  the  defocus  is  just  right 
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in  the  sense  that  the  defocused  channel  adds  maximum  information  to  that 
present  in  the  in-focus  image.  A  measure  of  added  information  is  conditional 
FI,  which  may  be  defined  as  the  difference  between  the  FI  of  the  two  image 
channels  taken  together  and  the  Fi  in  the  in-focus  image  alone.  Note  that 
since  the  concept  of  Fisher  information  is  defined  only  relative  to  certain 
parameters  that  are  being  estimated,  the  matter  of  optimization  is  also  a 
subjective  one,  depending  on  the  set  of  estimation  parameters.  The  depen¬ 
dence  of  optimum  performance  on  the  imaging  task  (“which  parameters  are 
to  be  estimated?”)  is  a  fundamental  element  of  all  information  theoretic 
considerations. 

Previous  work  by  other  researchers  was  devoted  to  addressing  this  opti¬ 
mization  question  relative  to  the  task  of  estimating  the  random  pupil  phase 
parameters  that  are  realized  frame  by  frame  under  a  given  turbulence  con¬ 
dition.  The  Pi’s  work  under  the  grant  was  instead  directed  to  the  matter 
of  estimating  the  object  itself,  a  task  that  can  be  mathematically  cast  as 
one  of  estimating,  for  instance,  the  object  spectrum.  The  FI  matrix  de¬ 
fined  relative  to  the  object  spectral  parameters  was  evaluated  under  the 
assumption  that  the  turbulence  induced  phase  degradations  are  sufficiently 
strong,  D/tq  »  1,  for  which  the  image  spectra  approximately  obey  Gaus¬ 
sian  statistics  whenever  the  light  levels  are  sufficiently  bright  so  any  shot 
noise  can  be  ignored  altogether  and  only  the  Gaussian  noise  of  CCD  read¬ 
out  is  of  any  consequence.  These  somewhat  restrictive  conditions  required 
for  Gaussian  statistics  apply  nevertheless  to  situations  of  practical  interest, 
e.g.,  low-contrast  images  with  high  bias,  fast  thermal  imaging  with  intrinsi¬ 
cally  bright  sources,  etc. 

Under  these  conditions,  the  following  expression  was  obtained  for  the 
joint  FI  in  the  two  channels[12,  13]: 


x  Sf*(u  i)  Sf(u2)  ' 
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and  denotes  the  inverse  of  the  2x2  image-spectrum  covariance  matrix 
at  a  given  spatial  frequency.  The  symbol  of  denotes  the  detector  noise 
variance  at  each  pixel  in  the  ith  channel.  A  similar  but  simpler  expression 
may  be  written  down  for  the  FI  in  the  in-focus  image  plane  alone, 


Jm[f(Ul)J(H2)]=S(ul-U2) 


l(ho(ui))|2 

Cm(«i) 


+  *(0)|/(ui)|2|A)(tfi)|2 
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where  the  function  fio(u)  is  defined  as 


m)= 


4o  }(g) 
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The  first  term  on  the  right-hand  side  in  Eqs.  (1)  and  (3)  represents 
the  FI  about  the  object  that  is  contained  in  the  two  mean  images  and  the 
in-focus  mean  image,  respectively,  while  the  remaining  terms  represent  the 
contribution  made  by  the  information  present  in  the  fluctuations  of  the 
image  spectrum.  For  any  speckle  based  system,  it  is  well  known  that  the 
latter  information  extends  out  to  the  diffraction  cut-off  uc,[15]  while  the 
former  is  negligible  for  frequencies  that  exceed  the  much  smaller  atmospheric 
cut-off  frequency  ua. 

These  expressions  were  graphically  displayed  and  discussed  in  Ref.[12, 
13],  and  it  was  determined  that  a  defocus-dependent  quadratic  phase  be¬ 
tween  3-7  radians  at  the  edge  of  the  pupil  in  the  defocused  channel  was 
optimal  in  extracting  maximum  possible  source  information  in  the  limit  of 
an  unresolved  point  source.  These  numbers  agree  with  the  optimal  values 
of  defocus  phase  corresponding  to  the  optimum  estimation  of  random  pupil 
phase  parameters  under  a  wide  range  of  operating  conditions,  as  shown  by 
previous  researchers.  Our  results  thus  give  us  much  confidence  that  the  op¬ 
timum  defocus  value  is  optimized  at  once  for  both  object  and  pupil  phase 
estimation  tasks  of  a  conventional  two-channel  PDS  imaging  system. 

Our  general  approach  based  on  FI  can  be  extended  to  a  more  compre¬ 
hensive  set  of  optimization  questions  for  PDS  imaging,  namely  how  many 
channels  and  what  known  phase  perturbation  beyond  defocus  might  be  the 
most  optimal  under  a  given  set  of  operating  conditions.  Our  preliminary 
work  [14]  has  indicated  that  the  form  of  the  pupil  phase  in  the  diversity 
channel  may  not  be  very  critical  in  the  context  of  PDS  imaging.  Recent 
studies  [16,  17]  in  extended  focus  imaging  systems,  however,  have  estab¬ 
lished  the  value  of  carefully  engineered  pupil-phase  profiles  in  improving  the 
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quality  of  restored  images,  and  such  pupil  phases  may  be  important  in  fu¬ 
ture  generations  of  PDS  imaging  systems  as  well.  In  many  of  the  general 
derivations  presented  here,  no  specific  use  is  made  of  the  fact  that  there 
are  only  two  channels  and  that  the  diversity  phase  is  a  pure  defocus.  The 
present  theoretical  framework  can  thus  be  readily  adapted  not  just  to  more 
general  forms  of  PDS  imaging  but  even  to  the  most  general  of  optical-digital 
imaging  systems. 

e.  Fisher-information  based  characterizations  of  the  focus  ex¬ 
tension  problem 

By  suitably  phase-encoding  optical  images  in  the  pupil  plane  and  then  dig¬ 
itally  restoring  them,  one  can  greatly  improve  their  quality.  The  use  of 
a  cubic  phase  mask  originated  by  Dowski  and  Cathey  [16]  to  enhance  the 
depth  of  focus  in  the  images  of  3-d  scenes  is  a  classic  example  of  this  powerful 
approach. 

Two  years  ago,  working  in  collaboration  with  a  team  of  researchers  at  the 
Wake  Forest  University  led  by  Professor  Robert  Plemmons,  the  co-PI  of  the 
AFOSR  grant,  the  PI  proposed  a  radical  generalization  of  this  approach  that 
is  based  on  the  theory  of  mathematical  optimization.  In  our  approach,  which 
we  call  pupil-phase  engineering,  we  first  expand  the  pupil  phase  function  in 
a  set  of  basis  functions,  such  as  the  orthogonal  Zernike  polynomials  or  the 
ordinary  nonorthogonal  (but  linearly  independent)  polynomials.  We  then 
choose  the  set  of  values  of  the  coefficients  of  such  expansions  by  imposing  the 
requirement  that  there  be  both  maximum  possible  invariance  of  imaging  to 
the  depth  coordinate  as  well  as  maximum  possible  digital  restorabilty  of  the 
phase-encoded,  intermediate  image.  This  defines  an  optimization  problem 
to  which  modern  tools  of  optimization  theory  can  be  readily  applied.  Our 
approach  is  sufficiently  general  in  that,  as  we  have  recently  shown  [18],  it 
can  be  used  to  compensate  for  undetermined  types  and  strengths  of  imaging 
system  aberrations  as  well.  It  thus  ensures  that  the  encoded  image  will  be 
formed  under  a  nearly  shift-invariant  imaging  condition,  which  can  then  be 
digitally  restored  to  a  high  overall  quality  nearly  free  from  the  aberrations 
and  limited  depth  of  focus  of  a  traditional  imaging  system. 

A  very  useful  measure  of  sensitivity  of  images  to  focus  and  aberrations 
related  errors  is  based  on  the  concept  of  Fisher  information.  In  order  to 
demonstrate  the  validity  of  our  general  approach,  we  obtained  results  of  com¬ 
puter  simulations  that  include  the  limitations  imposed  by  detector.  Fisher 
information  also  provides  a  very  useful  physical  characterization  of  the  trade¬ 
off  between  longitudinal  (or  focus)  blur  and  transverse  blur  (of  the  phase- 
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encoded  blurry  image).  It  is  this  trade-off  that  lies  at  the  heart  of  our  PPE 
approach  to  curb  focus  blur. 

A  number  of  papers  [19,  20,  17,  21,  22]  that  cite  AFOSR  grant  support 
have  been  -  and  continue  to  be  -  published  over  the  past  two  years.  They 
have  firmly  established  the  effectiveness  and  superiority  of  the  optimization 
approach  when  compared  to  the  original,  somewhat  simplistic  cubic-mask 
approach.  Our  PPE  approach  -  and  its  information  theoretic  characteri¬ 
zation  -  provide  the  best  framework  in  which  to  discuss  the  more  general 
problem  of  integrated  imaging  systems  which  are  optimized  against  a  num¬ 
ber  of  system  performance  trade-offs,  not  just  the  longitudinal  vs.  transverse 
trade-off  we  mentioned  earlier  in  the  context  of  focus  extension. 

f.  Information  theoretic  sum  rules  in  the  physical  and  Fourier 
domains 

Physical  symmetries  and  conservation  laws  provide  the  most  fundamental 
basis  for  all  valid  physical  theories.  Notable  among  such  conservation  laws 
are  energy,  linear  momentum,  angular  momentum,  charge,  and  the  invari¬ 
ance  of  physical  laws  under  general  coordinate  frame  transformations.  In 
the  context  of  signal  and  image  processing,  an  important  conserved  quantity 
is  the  total  noise  power  which  is  invariant  under  Fourier  transformations, 
making  it  possible  to  compute  and  interpret  it  in  the  physical  or  Fourier 
domain  with  equal  ease  and  convenience. 

Information  theory  [1]  provides  another  important  ingredient  of  any  de¬ 
scription  of  modern  signal  processing,  computation,  and  communication  sys¬ 
tems.  Over  the  past  fifty  years,  our  familiarity  with  information  has  grown 
to  the  extent  that  we  have  come  to  regard  it  as  being  on  par  with  other  fun¬ 
damental  entities  like  energy,  power,  etc.  In  fact,  serious  attempts  [23,  24] 
have  been  recently  made  to  elevate  information  theory  even  further,  by  ex¬ 
ploring  whether  it  can  serve  as  an  essential  construct  for  all  physical  laws  of 
nature. 

In  a  paper  recently  submitted  for  publication  [25],  we  have  derived  cer¬ 
tain  sum  rules  for  Fisher  information  and  quantities  directly  related  to  it. 
These  sum  rules  govern  the  conservation  of  integrated  information  and  re¬ 
lated  quantities  under  transformations  of  the  Fourier  type.  They  serve  to 
illuminate  the  fundamental  meaning  assigned  to  Fisher  and  other  types  of 
information  as  practical  measures  of  information  and  knowledge.  The  con¬ 
text  in  which  we  derived  our  sum  rules  is  imaging,  but  the  results  axe  general 
and  apply  to  any  kind  of  signal  one  can  imagine. 

The  results  of  this  paper  demonstrate  that  for  both  unbiased  and  biased 
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estimation  problems,  there  are  conservation  laws  that  govern  the  transfor¬ 
mation  between  physical  and  Fourier  domains.  These  laws  relate  to  ordinary 
and  uniform  Cram6r-Rao  bounds  in  their  sum  form,  as  shown  in  this  paper. 

g.  Summary  and  Conclusions 

In  the  three-year  grant  period,  a  number  of  information  theoretic  characteri¬ 
zations  and  elaborations  of  imaging  systems  were  successfully  pursued,  lead¬ 
ing  to  some  seminal  results.  Our  grant  funded  researches  have  clarified  the 
nature  of  Fisher  information  (Secs.  3  and  6);  established  the  value  of  using 
information  theory  to  characterize  the  absolute  and  relative  performances  of 
various  image  processing  algorithms  (Sec.  2);  helped  us  quantify  the  degree 
of  noise  reduction  and  information  gain  resulting  from  application  of  prior 
knowledge,  such  as  support  (Sec.  1);  demonstrated  the  usefulness  of  Fisher 
information  in  assessing  the  degree  of  invariance  in  focus-extension  and/or 
aberration-control  problems  (Sec.  5);  and  illustrated  the  pre-eminence  of 
information  as  a  comprehensive  metric  for  assessing  and  optimizing  the  per¬ 
formance  of  integrated  imaging  systems,  like  phase-diverse  speckle  imaging 
(Sec.  4).  Unlike  the  traditional  noise-based  performance  analyses,  an  infor¬ 
mation  theoretic  metric  of  performance  encapsulates  all  measures  of  image 
quality,  including  sensitivity,  resolution,  and  dynamic  range,  in  a  single  task- 
dependent  quantity.  Information  theory  provides  a  physically  insightful  ap¬ 
proach  to  discussing  various  system  trade-offs  that  are  critical  for  optimizing 
the  performance  of  modern  imaging  systems. 
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